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for  Randomized  Fractional  Replication  Designs 

by 

S.  Zacks 


1.  Introduction 

Fractional  replication  designs  have  become  of  great  importance, 
especially  for  industrial  experimentation.  A  missile  whose  operation 
is  affected  simultaneously  by  dozens  of  interacting  factors  would  pro¬ 
duce  a  full  factorial  experiment  of  impractical  size.  Indeed,  if  there 
are  more  than  20  factors  which  may  affect  the  operation  of  a  missile, 
and  if  we  like  to  attain  complete  information  on  all  the  main  effects 
and  interactions  of  the  controllable  factors  we  would  run  the  experi- 
ments  over  more  than  2  =  1,048,576  treatment  combinations.  Fractional 

replication  designs  are  planned  to  attain  information  about  some  of 
the  main  effects  and  interactions  by  a  relatively  small  number  of  trials. 
If  the  operation  of  a  missle  can  be  controlled  with  some  information  on 
the  main  effects  and  some  low  order  linear  interations,  it  might  be 
sufficient  to  run  only  52  or  64  trials  at  a  time.  These  however,  should 
be  chosen  from  those  possible  in  some  optimal  manner. 

The  problem  of  choosing  a  l/2m  s  fractional  replication  and  an 
appropriate  estimator  of  the  parameters  characterizing  the  factorial 
model  (main  effects  and  interactions)  has  been  studied  by  A.  P.  Dempster 
(i960,  1961),  K.  Takeuchi  (1961),  S.  Ehrenfeld  and  S.  Zacks  (1961, 

1962)  ,  S.  Zacks  (1962),  B.  V.  Shah  and  0.  Kempthorne  (1962a, b).  In 
all  these  studies  the  type  of  estimators  considered  is  that  which  yields, 
under  a  randomized  procedure  with  equal  probabilities  of  choice,  unbiased 


estimates  of  a  specified  linear  functional  of  a  subvector  of  parameters, 
which  lies  in  the  range  of  the  design  matrix  (the  matrix  of  the  corres¬ 
ponding  normal  equations). 

In  the  present  study  statistical  properties  of  the  generalized 
least  squares  estimators,  under  randomized  fractional  replication  de¬ 
signs,  are  studied.  The  term  generalized  least-squares  estimators  (de¬ 
noted  henceforth  by  g.l.s.e.)  is  used  since  the  matrices  of  the  nor¬ 
mal  equations  corresponding  to  these  designs  are  singular.  The  fac¬ 
torial  models  corresponding  to  the  type  of  fractional  replication  de¬ 
signs  studied  in  the  present  paper  is  presented  in  section  2.  For  this 
sake  we  start  from  the  factorial  model  for  a  full  factorial  system. 

Then  we  present  the  required  algebra,  and  the  method  of  constructing 
the  orthogonal  fractional  replications.  The  linear  spaces  of  all  g.l.s.e. 
associated  with  the  various  orthogonal  fractional  replication  designs 
are  characterized  in  terms  of  the  linear  coefficients  of  the  corres¬ 
ponding  factorial  models.  Some  statistical  properties  of  the  g.l.s.e. 
under  procedures  of  choosing  a  fractional  replication  at  random,  are 
then  studied.  First  we  prove  that  there  is  no  g.l.s.e.  which  yields 
unbiased  estimates  of  the  entire  vector  of  2m  parameters.  However, 
there  are  g.l.s.e.s  which  estimate  unbiasedly  subvectors  of  parameters. 
The  trace  of  the  mean-square-error  matrix  corresponding  to  a  g.l.s.e. 
applied  under  certain  randomization  procedure  is  used  as  a  loss 
function  for  the  decision  problem  of  choosing  a  g.l.s.e.  and  a  ran¬ 
domization  procedure.  It  is  shown  that  when  the  parameters  of  the 
factorial  system  may  assume  arbitrary  values,  the  randomization  pro¬ 
cedure  which  assigns  equal  probabilities  to  various  fractional 
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replications  (denoted  by  R.  P.*)  ie  admissible.  Bayes  g.l.s.e.,  relative 


to  a-priori  information  available  on  the  parameters,  are  then  studied. 
This  leads  to  a  minimax  theorem,  which  specifies  a  minimax  and  admis¬ 
sible  g.l.s.e.  under  R.P.*.. 

The  relationship  between  the  generalized  inverse  of  the  matrix  of 
normal  equations  and  g.l.s.e.  as  given  by  A.  Ben-Israel  and  J.  Wersen 
(1962),  and  by  C.  R.  Rao  (1962)  is  studied.  It  is  shown  that  these 
are  particular  cases  in  the  general  class  of  g.l.s.e.  studied  presently. 

Finally,  it  should  be  remarked  that  although  the  present  paper 
deals  with  factorial  system  of  order  2m  all  the  important  results 
hold  in  more  general  factorial  systems  of  order  pm  (p  >  2). 
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2.  Eae  statistical  model  for  fractional  reg^cation  designs. 

2. a.  The  statistical  model  for  a  full  factorial  experiment 
of  order  2m. 

A  full  factorial  experiment  of  order  2m  is  a  set  of  2m  treat¬ 
ment  combinations,  consisting  of  m  factors  X  X  ,  each  at 

two  levels.  Such  a  system  can  be  characterized  by  2m  parameters 

a  ,...,  a  ,  which  are  the  coefficients  of  the  multilinear  re- 
o  2m-l 

gression  function: 


XX,  X  , 
ov  1  v  m-1 


(2-1)  B(Y(X  , . .  .,X  ))  =  S  a(x . ,  )  *„V-  Ci 

X  ,...,X  , )  o  '  m-1 

o  m-1' 


m-1  . 

where  X  =  0,1  ( J=0, . . . ,m-l);  u(X  ,...,X  )  =  J  X  2J; 

J  J=0  J 


and  Y(X  ,...,X  ,)  is  a  random  variable  representing  the  "yield"  of 

o  m-i 

the  experiment  at  treatment  combination  (X  ,...,X  ,).  Denote  by 

o  m-1 

X,  _  and  X  ( J=0, . . . ,m-l),  X  <  X  ,  the  two  specified  levels 

J»u  J,i 

of  factor  Xj .  By  changing  variables  according  to  the  transformation 

xi  k  -  i  (xi  o  +  xi  i} 

(2.2)  Z  =  k (k=0,l;J=0,...,m-l) 

—  (X  -  X  } 

2  iXj,l  XJ,0; 

the  regression  function  (2.1)  is  reduced  to  the  form: 


2m-l 


-  XX  X 

(2.5)  E(Y(Z  ,...,Z  ■,))=!  P  Z°Z.1...Zmr 

'  o  ra-1  u  o  1  m-1 

u=0 


where  Z^  =  -1,  +1  (j=0, . . . ,m-l);  and  usu(Xo, . . ,,Xm  ^) 
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1-i  j 


Writing  Z  =  (-1)  ^  with  i  =  0,1  for  all  J  =  0, .  ..,tn-l  ,  the 

J  J 

regression  function  (2.3)  can  be  represented  in  the  form: 


2m-l 


(2.4)  £{¥(^,...,1^)}  =  2  PJ-V 


m-1 

Z  V1'1^ 

J=0  J  J 


u=0 


m-1 


Furthermore, 


denote  by  x  3  (i  ),  v  =  J  i.  2  ,  the 

v  ^  ni»x  j  =0  ^ 


2  treatment  combinations  of  the  factorial  system  under  considera¬ 
tion;  and  let 

m-1 

2  x d-i  ) 

(2.5)  c1'2  ^  =  (-l)J=°  - - -  "  "  " 

'  '  vu 


,  for  all  v,u  =  0, ...,  2  -1 


then  (2.4)  is  reduced  to  the  form: 


(2.5) 


2m-l 


/  p^  \  *  _ 

E{Y(x  ))  =2  Pu  Cvu  ’  for  a11  v  =  -1 

u=0 


Let  Y'  =  (Y(X  ),...,Y(X  ))  be  the  vector  of  observations  at  all 

o  2m-l 

the  2  treatment  combinations;  and  let  P'  =  (P  ,  ...,P  )  be  the 

o  2m-l 

vector  of  parameters  of  (2.5).  Thus,  if 

<C^)  =  ||c£  }||  ,  (v,u  =  0, . . . , 2m-l) , 

denotes  the  matrix  of  the  coefficients  of  the  P's  in  (2,5),  then 
the  statistical  model  for  a  full  factorial  system  can  be  written  as: 


(2.6) 


Y  =  (C^2  ^)  p  +  e 


where  e  is  a  random  vector,  with  E  e  =  0  and  E  ee' 
(n) 

(i'  '  denoting  the  identity  matrix  of  order  n). 


2  (2m) 

=  a  I  ' 
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2.b.  The  algebra  of  factorial  experiments ■ 

(2m) 

2.b.l.  Properties  of  the  matrices  (Cr  ) 

(2m) 

The  properties  of  the  matrices  (C  ' )  will  be  presented  without 

proofs.  For  details  see  S.  Ehrenfeld  and  S.  Zacks  (l96l). 

(2m) 

The  matrices  (Cv  ')  ,  m  =  1,2,...,  of  (2.6)  can  be  obtained 
recursively  by  the  following  relationship: 


(2.7) 


-1 

1 


(2m-lv 

®  {Cy  >)  ,  m  =  1,2,... 


where  (C^0^)  h  1  (scalar),  and  where  A®B  is  the  Kronecker's 
direct  multiplication  of  the  matrix  A  by  the  matrix  B  from  the 


left,  defined  as  follows:  If  A  is  an  n  x  m  matrix  ||a^j||,  and 

B  is  a  k  x  1  matrix  ||b  ||,  then  A®B  is  the  nk  x  ml  matrix: 

rs 


A®  B 


"all 

B 

•  •  • 

'a,  B 

1  lm 

* 

1 - 

1  • 

1  " 

1  • 

• 

|  • 

1  • 

1  • 

a 

B 

1 

:  a  B 

nl 

1 

j  ^ 

From  the  associative  property  of  the  Kronecker's  direct  multiplica- 

(2m) 

tion  it  follows  that  every  matrix  (Cv  ')  can  be  factorized  into 
2m”8x  2m  B  (1  <  s  <  ra)  submatrices  of  order  2s  x  2s  ,  according  to 
the  relationship: 


(2.8) 


(0<2”))  - 


(2m-S) 


(C 


)  ® 


(l  <  s  <  m) 
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(2m) 

From  this  relationship  it  follows  that  the  elements  of  (C  ' )  are 

(2®“b\  (2s\ 

related  to  those  of  (C  ')  and  (Cv  ')  according  to: 


(2.9) 


(2m)B  ( 2s)  .  (2m_B) 

Ci+J2e,t  "  Li,rt 


?m-sN 


for  all  i  =  0, ...,2S-lj  j  =  0,  ...,2m”8-l}  and  where  t  =  r^  +  q^2B 
(rt  =  0, . . .  ,2S-1  ;  =  0,...,2m_e-l)  . 

( 2m) 

Another  useful  relationship  among  the  elements  of  (Cv  ')  is 
the  following  one:  Let  u]_>u2  =  0,...,2m-l  he  given  by 

Uj  =  ^(m-l)i^  (^=^->^»  i  =  0>1  ( j=0, . .  .,m-l),  and 

define  u,  0uo  s  (X',...,X'  )  where  X'  =  X  +  X  „  (mod.  2); 

1  2  o  m-1  j  jl  j2  " 

then 


(2.10)  c<^L  =  C(2m)  •  for  every  v=0,...,2“-l 

V,u^yu2  V  >U^  V,Ug  *  ’ 

(o')  (2m) 

The  properties  of  (Cr  ')  are  extended  into  (Cv  )  by  the 
recursion  relationship  (2.7),  and  are  summarized  as  follows: 

,(2m) 


~m 


(i)  C. 


,m 


v,0 


1  for  every  v  =  0,  ...,2  -1 


(ii) 

(2m) 

CT  ;  =  1 

2m-l,u 

for 

every  u  =  0, . . 

(iii) 

2-1  f2nu 

7  c(2  ' 

o  vu 

=  0 

for  every  v  =  ' 

u=0 

(iv) 

2-1  (2m) 
T  c(2  ] 

v=0  w 

=  0 

for  every  u  =  1 

~jn 


m 


u  =  1, . . .,2  -1 
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2?1  , 

(v)  y  C(2  }  C  2  } 
v=0  ™1  VU2 


2“‘  ,  if  ux  =  u2 


0  ,  if  ux  4  u2 


and 


niiin 


(vi)  f  C^>  - 

u=0  V1U  V2U 


2  ,  if  v1  =  v2 


0  ,  if  V1  i  v2 


(v)  and  (vi)  can  be  expressed  also  in  the  form: 

(C^2  V  (C(2  ))  =  (C^2  })(C(2  V  =2m3^2  ^ 


2.b.2.  The  group  of  parameters . 

Every  parameter  P^  (u  =  0,...,2m-l)  of  the  statistical  model 
(2.6)  can  be  represented  by  an  m-tuple  P^  =  (X.q,  ...,X.m  p)  where 
X.  ^  -  0,1  (j  —  0 ,  •  ■ . , m- 1 ) • 

The  set  of  all  2m  parameters  constitutes  a  group,  B  with 

respect  to  the  operator  defined  as  follows: 

m-1  .  m-1  , 

Let  u-,  =  I  L  2J  and  u?  =  \  \\  2J  then  P  =  P  ®P 

1  j=0  J  d  j=0  J  K  1  u2 


m-1 

if,  and  only  if  k  =  [  V'  2^  where  X." 

J=0  J  J 


\  +  X'  (mod.  2)  for 

J  J 


all  J  =  0,  . . .,m-l. 

The  unit  element  of  the  group  B  is  Pq  h  (0,0,..., 0)  and  the 

inverse  of  P  =  (X.  )  is  p  s  (2-X.  ,2-X.  ,... ,2-X  )(mod.  2). 

u  o  m-i  u  ox  m-x 

A  set  of  n  parameters  Pu  ,  P^  ,...,Pu  is  called  dependent  if  there 
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exist  n  constants  a^  (k*>l, . .  ,,n),  not  all  of  which  are  zero 
(a^  =  0,1),  such  that: 


(2.11) 


cl  &  €L 

[pu  ]  1  ®  K  ]  2  ®  tPu  ]  n  =  e0 


where 


[P  ]S  = 
u 


P  ,  if  a  =  1 
u 


,  if  a  =  0 


If  relationship  (2.11)  is  valid  only  when  all  =  0  (k=l,...,n) 

then  P  ,  ...,P  are  called  independent .  It  is  easy  to  check  that 
U1  un 

every  set  of  n  independent  parameters  (1  <  n  <  m)  generates  a  sub¬ 
group  of  order  2n  in  B. 

2.c.  The  construction  of  a  l/2m-s  (1  <  s  ,  m)  fractional 
replication. 

Let  {p^  ,Pd  , ...,Pd  )  be  any  set  of  m-s  independent 

o  1  m-s-1 

parameters  in  B.  The  2m  treatment  combinations  can  be  classified 
into  2m  B  disjoint  subsets  Xv(v=0, . . . ,2m  s-l)  of  equal  size,  re¬ 
lative  to  the  specified  m-s  independent  parameters,  in  the  following 

manner:  Let  P,  =  (X  .  ,  X,  .  ,  X  .,  .  )  k  =  0,..., m-s-1  be 
dk  o^  1,^  m-l^ 

a  defining  parameter,  and  let  X  =  (i  , ...,1^  )  be  a  treatment  com¬ 

bination,  then  x  e  Xy  if,  and  only  if, 


(2.12) 


m-1 

Y  i,  X  s  a  (mod.  2),  and  where 
J=0  J  K 


m-s-1 

v=  I 

k=0 


ak  2 
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In  order  to  perform  the  classification  of  treatment  combinations  into 

the  blocks  X^  (v  =  0, . „ .,2m-B-l)  we  do  not  have  to  solve  the  linear 

equations  (2.12),  but  it  suffices  to  compare  the  rows  of  the  matrix 

(2m) 

of  coefficients  (CO  )  under  the  columns  corresponding  to  the 

special  independent  parameters  ).  These  two  procedures 

o  m-s-1 

are  equivalent  (see  S.  Ehrenfeld  and  S.  Zacks  (1961)).  The  m-s  inde¬ 
pendent  parameters,  relative  to  which  the  classification  takes  place, 
are  called  defining  parameters .  The  answer  to  the  question,  which  of 
the  parameters  should  be  specified  for  the  role  of  defining  ones  de¬ 
pends  on  the  objectives  of  the  experiment.  The  choice  of  a  set  of  de¬ 
fining  parameters  will  generally  effect  the  bias  of  estimators  and 
their  variances,  and  might  have  other  effects  on  the  properties  of 
statistics  and  procedures  (see  0.  Kempthome  (1952)}  S.  Ehrenfeld  and 
S.  Zacks  (1961). 

The  term  fractional  replication,  in  its  broadest  sense,  relates 

to  any  subset  of  treatment  combination  from  a  full  factorial  system. 

K.  Takeuehi  (1961)  considers  designs  of  randomly  combined  fractional 

replications.  We  shall  consider  in  the  present  paper  only  fractional 

replications  which  consist  of  one  block  of  treatment  combinations,  X^, 

m*  s 

chosen  from  the  set  of  2  blocks  constructed  according  to  the  pro¬ 
cedure  outlined  above.  These  fractional  replications  are  called 
orthogonal .  A  randomized  fractional  replication  procedure  is  one  in 
which  a  block  Xy  is  chosen  with  a  probability  vector  =  (|q, . » . ,l2m" 

2.d.  The  statistical  'model  for  a  l/2m’s  fractional  replication. 

Let  ,.„.,Pd  ]  be  a  set  of  defining  parameters} 

o  m-s-1 

(X  }  v  =  0, . . ,,2m”s-l)  the  corresponding  blocks  of  treatment  combinations 
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and  Y(Xy)  the  vector  of  observations  associated  with  the  2s  treatment 
combinations  in  Xy.  The  order  of  the  components  of  Y(Xv)  is  deter¬ 
mined  by  the  standard  order  of  the  corresponding  x's  in  X^,  e.g.  if 
Xv  =  (xo>  x3»  x5»  x6*  then  Y^xv^'  =  (Y^x0)>  Y(xj)>  y(x5)>  Y(x6)). 

Let  P^  =  (P  >  P*  >  •  •  •  >  )  he  any  specified  vector  of  2s 

o  h2s_1 

parameters  independent  of  the  defining  parameters  (except  for  the  "mean" 
PQ);  with  tfc  <  tk+1  for  all  k  =  1,...,2B-1.  Let  (p*  ;  u=0, . . . ,2m--l) 

m_  g 

be  the  subgroup  of  2  parameters,  generated  by  the  m-s  defining 


parameters.  Define  by  pv  '  (u  =  1,  ...,2  -l)  the  vector  of  2 

parameters  obtained  by  multiplying  each  of  the  components  of  P^  by 
P*,  i.e.,  p(u)  =  (PqQP*,  Pt  (x)  p*,...,  Pt  ®  p*)»  .  Then,  the 


“2S-1 


statistical  model  for  Y(X^r)  can  be  written  in  the  form 

(2.13) 


v 

-m-e 


2  -1  b 

Y(X  )  =  V  (P(2  h  P(u^  +  €  =  (P  )p*  +  e 
v  vu  v ' 

u=0 


where;  as  proven  by  S.  Ehrenfeld  and  S.  Zacks  (1961) 


(2.H)  (Pv)  -  (1,  b<*  '  > . b^2m-s1)>  ®  <P^  ’> 


is  a  2Sx(2m-2s)  matrix;  (P^  is  a  2“  x  2°  matrix  obtained 
^m 
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(2  )  (2“*) 
from  (C  '),  by  picking  the  elements  of  (C  ;)  corresponding  to 

treatment  combinations  in  X  and  the  parameters  in  P^  ,  and 

(2m_s) 

arranging  them  in  the  standard  order.  The  scalars  b^  ,  by  which 

(2s)  (2s) 

we  multiply  (P^q  ')  to  obtain  (P^  )  ,  are  given  by  the  formula: 


(2.15) 


m-s-1 

_  _  t  d;  (i.-L(d  )) 

/  Om  ®  \  4  — O  J  J  J 

b\2  '  =  (-1)J"° 


vu 
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where  v 


m-s-1  ,  ra-s-1  , 

3<J  .  ,,  -  V  ^  I  ?>J 


m-1 


X  i.  2J;  u  =  X  i*  2J  and  L(d.)  2  £  v  (mod.  2), 

J=0  J  J-0  J  J  k=0  “,dj 

for  every  defining  parameter  p.  ;  and  where  p*  =  (P^  p^  P^2 

J  ... 

s  2(2°') 

and  e  is  a  random  vector  of  order  2  ,  with  Ee  =  0  and  Eee'  =  o  I1  . 


It  can  he  readily  proved  that,  the  rows  of  (P^2  (v,u=0, . ..,2m”-l), 

as  well  as  its  columns,  are  orthogonal,  i.e., 


vu 


(2.16) 


(P^)  (p(2*>)  =  (P^MP^)'  =  2s 

vu  vu  '  vu  '  vu 


for  all  v,u=0, ...,2m  -lj  and  that  a  similar  property  holds  for  the 

(2m“6)  .  (2m-8) 

matrix  (B),  '  s),  whose  elements  are  the  coefficients  b  , 

defined  by  (2.15),  i.e., 


(2.17) 


(B 


( 2  ) 

(d  ... 


•A 


m-s-l 


)’  (B 


(d 


,,dm-s-l^ 


2m-s  I(2 


m-Sx 


for  every  choice  of  m-s  defining  parameters.  For  the  sake  of  simpli¬ 
fying  notation,  let  S  -  2B  and  M  =  2ra_s,  N  =  S*M  =  2m.  Furthermore, 
assume,  without  loss  of  generality,  that  the  defining  parameters  are  the 

"main  effects"  (Pg>P2S  ’’"’^H/2*  and  that  =  ^o’^l'  *  * '  ’  ^S-l^ ' 

then,  the  blocks  of  treatment  combinations  are: 


(2.18)  {Xi+vS  *  1  =  for  all  v  =  0,...,  M-1 

and  the  statistical  model  for  Y(X^)  is  given  by: 


(2.19) 


Y(XJ  =  [(1,  C^,...,  C 


,(M) 

r(M-l) 


) ®  (C(S))]  p  +  e 


-  (c(sV0>  .  Y  C,H)  ^ 

VU 


+  e 


u=l 


where 


,(u) 


p  ~  (Pus’  ^1+us* *  *  * '  p(u+l)s-l)' 
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3.  Generalized  least  squares  estimators  for  fractional  replications. 


3. a.  The  set  of  all  least  squares  estimators . 


Given  a  block  of  treatment  combinations  X_^  (v=0, . . . ,M-l)  and  the 
associated  vector  of  observations  Y(X^),  the  "normal  equations"  cor¬ 
responding  to  the  linear  model  (2.19)  are  given  by: 


(3.1) 


(cv)*  (cv)e  =  (Cy)'  Y(Xv) 


V  — 0 y  •  «  •  y  M- 1  y 


where  (C^)  is  the  S  x  N  matrix  of  the  coefficients  of  (2.19),  i.e., 


(3-2) 


(C  ) 

V 


(i,  c 


(M)  c(M)  )6D(c(s)) 

vl  v(M-l);QUlC  j 


A  generalized  least  squares  estimator  (g.l.s.e.)  of  P  is  any 

( s ) 

linear  operator  (Ly),  on  ;  (Eucliden  S-space),  so  that  (L^) 
is  an  N  x  S  matrix  satisfying  the  equation: 


(3.3)  (CvV  (Cv)(Lv)  =  (Cv)'  ,  v=0, . . . ,M-1 


Let  (L  )'  =  ( (L  )'  :  (L  ,)•:..*.  (L  .  O')  where  (L  ) 
v  vo  .  vl  .  .  v(M-l)  vu 

(u=0, .. .,M-l)  are  square  matrices  of  order  S  x  S.  Substituting 
from  (3-2)  for  (C  )  in  3.3  and  decomposing  (L  )  as  indicated 


we  arrive  at  the  matrix  equation: 


(3.4)  S[(Q(M))®(I(S))1 


(L  ) 
vo 


'Lv(M-l)^ 


1 

r(M) 

vl 

• 

• 

’(M) 

v(M-l) 

®(C(S))' 


where 


(Q(M))  = 


(1,C 


(M) 
vl  ’ 


C(M)  )• 

v(M-l) 


(l,c 


(M) 
vl  ’ 


C(M)  ) 
'  ’  v(M-l); 


is  a 
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square  symmetric  matrix  of  order  M  x  M,  whose  (i,j)-th  element  is 

(M)  =  C(M)  C(M)  (i  J=0  M-l).  Since  =  +  1  and  (C^) 

uiJ  vi  vj  ’  vu  - 

is  non-singular,  the  linear  equations  in  the  matrices  (L  )  can  be 

expressed  in  a  form  equivalent  to  (3.^)  as, 


(5-5) 


M-l 


T  (L  )(c^b;)  =  I 

Vll  X  Vll  '  ' 


(S)s  _  T(s) 


u=0 


VU  vu 


(5.6) 


(s')  (s’) 

Since  the  unique  solution  to  the  equation  (H)(CV  ')  =  Iv  '  is 
(H)  =  g  (C(S))-  ,  it  follows  that  the  M  matrices  (L^^),  j=0,..., 
M-l,  whose  submatrices  are  given  by: 

1  C^(M)  (C(S))*  ,  if  u  =  j-1 

,  otherwise 

constitute  a  basis  of  M  independent  solutions  of  (5.5).  Thus, 
every  g.l.s.e.  (L  )  can  be  represented  as  a  linear  combination  of 
the  M  linearly  independent  operators  (L^)  ( j=0, . . . ,M-l),  so 
that  the  coefficients  of  (l|^)  add  up  to  1.  Formally,  the  set  of 
all  g.l.s.e.,  given  is: 


(L(J))  =  {  S  vu 

W  >  (o) 


(5.7) 


M-l  , ,,  M-l 

X(C  )  =  {(L  )  :  (L  )  =2  S  (L;J))  5  1  K  -  1) 


v'  A  J  v 


J=0 


Every  g.l.s.e.  can  thus  be  represented  by  M  coordinates 

M-i  A 

(X  , X  ,  ,  ..,X  )  such  that  £  X  =  1.  Furthermore,  if  (3  de- 

o  .1  *V'—  r  j  =0  ^ 

notes  the  vector  of  g.l.s.e.  of  P  then  we  have,  according 
to  (5.6)  and  (5-7) 


Ik 


(3.8) 


M-l . 


A 

e. 


1 

s 


C(M) 

VU 


r(M-l) 

Lvu 


®  (C(s))'  Y(Xv) 


for  every  v=0, . . . , 


3.b.  Some  statistical  properties  of  g.l.s.e. 

In  the  present  section  we  prove  that  there  are  no  unbiased  g.l.s.e. 

of  P,  and  derive  an  expression  for  the  trace  of  the  mean-square-error 

* 

matrix  of  a  g.l.s.e. 

Consider  a  fractional  replication  design  in  which  a  block 

(v=0, . . . ,M-l)  is  chosen  with  probability  £  (£  >  0  for  all 

M-l  v  v  - 

v=0, ...,M-1;  2  5  =  1).  A  randomized  fractional  replication  pro- 

v=0  v 

cedure  is  thus  represented  by  an  M-dimensional  probability  vector  | . 
This  class  of  randomization  procedures  contains,  in  particular,  the 
fixed  fractional  replication  design,  in  which  one  of  the  X^  blocks 
is  chosen  with  probability  one. 


Theorem  1. 

Let  (3^  =  i  (C^)'  Y(X  )  then  E  for 

S  vu  v  |*  1 

all  u=0, . . .  ,M-1  if,  and  only  if,  =  (±,  i,...,  i)\ 


Proof. 

u) 

The  expected  value  of  (3 
is  given  by: 


under  randomization  procedure  5  , 
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(3.9) 


h  ^(u))  =1  Y  Kc™  (c(s))’  y(xv) 


s  v=o  'v  ™ 


1  Y  C(M)  (C(S) 

S  *<_  v  vu  ' 


S  '  v  vu 

v=0 


M-l 


f  c«  <c<3V”>. 


w=0 


-Y  (Y  i  cw  c(M))p(w)  =  e(u)  +  t  y  5 

w=0  v=0  v  vu  vw  (wjm)=0  v=0 


M-l  M-l 


C(M)  C(M)  (w) 
^"vu  w 


Clearly,  if  |  =  -  for  all  v=0, ...,M-1,  then 


Y  i  c<M>  c<M>  =  i  Y  c<M>  c<M>  =  0 

v  vu  vw  M  vu  \ 

v=0  v=0 


w 


for  all  u  /  w  by  the  orthogonality  of  the  column  vectorB  of  (C^). 
Thus,  E^#  (P^)  =  for  all  u=0, ...,M-1.  On  the  other  hand, 

if  {P(u)}  =  p^  for  all  u=0, ...,M-1  then,  in  particular 


(3.10) 


y6(0)>-e<0).  Y  l1 

5  w=l  v=0 


M-l 


„(M) 


But  the  condition  £  C^'  =  0  for  all  w=l,  ...,M-1  is  equivalent 


v=0 


to  the  condition: 


(3.11) 


(C<«)-  5  - 


/  0 


\l 


Multiplying  both  sides  of  (5.1l)  by  (C'  ')  we  get: 


(M), 
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E{e) 


(3.12) 


ms  .  (c(M>)(c(M>)'  s  .(c(M>)|:j=  i<"> 

Is  an  M-dimensional  vector  with  unity  in  all  its  components. 

~(u) 

It  follows  that  a  necessary  condition  for  the  unbiasedness  of  0  is 
that  |  i  1^,  i.e.,  each  block  is  chosen  with  the  same  probability. 


where 


X(M) 


(q.e.d. ) 


Returning  to  the  g.l.s.e.  we  have: 


(5.13)  e  *  (ft  >e  ,((xo?(0)'  : 


O  .1  .  •  M-l 


where  4*  =  i  1(M)  -  ~  (1,1, . . . ,l) •  . 

M-l 

Since  1  =1  we  conclude  that  there  is  no  unbiased  g.l.s.e.  of  0. 

u=0  U 

The  g.l.s.e.  in  which  X,  =*  1  and  X  =0  for  all  u  >  0  yields 

o  u 

unbiased  estimates  of  the  components  of  0^  only.  Similarly  when 

X  =  1  (j=0, . . .,M-l)  and  X  ,  =  0  for  all  J‘  /  J,  the  corresponding 

J  *  u 

g.l.s.e.  yieldB  unbiased  estimates  of  the  components  of  0^  only. 

A 

The  mean- square -error  dispersion  matrix  of  a  g.l.s.e.  0  ,  under 
randomization  procedure  t>  is  defined  by  E^ { (0-0) ( $-0) 1 )  .  Let 

M(4 , X; 0)  denote  the  trace  of  the  mean-square-error  dispersion  matrix 

(M) 

of  a  g.l.s.e.  represented  by  a  vector  X,  such  that  X'l  =1,  under 
randomization  procedure  4  »  i.e.,  M(J,X;0)  =  E^((0-0)'  (£-0)}  . 
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Theorem  2. 


The  trace  of  the  mean- square-error  dispersion  matrix  under  ran¬ 
domization  procedure  i  is  given  by  the  expression: 


(3. 1*0  M(t,x»p)  =  (c2  +  lei2)  ^  (2X -l)|p(u)|2  + 

u=o  u  — ^  u 


M-l 

I 

u=0 


M-l  M-l 

+  I  (2V1)  l 

ux=0  (u2faJL)=0 


V  1  c<M>  c™ 

v=0  V  ^1  ™2 


(uj1  (u  ) 
P  P  2 


where  |p|2  =  P'P  ,  |p(u)|2  =  p(u)'p(u)  (u=0, . . . ,M-l)  . 


Proof. 

(3.15) 

MU,X,P)  = 

{(fUp)'(P-P))  = 

,  A  A 

E^  (P'P) 

According  to  (3-8) 

(3.16) 

,  A  A  1 

\  IP’M  -S 

Y  ^  E|  l*(Xv)-Y(Xv)) 

u=0 

Substituting  (2.19)  for 

Y(X  )  in  (3.16) 

we  get: 

(3-17) 

1  E  (Y(x  )•  y(X  )}  =  |e  {(Y 

C(M>  ( 

•  Y  <£f  (C(S))  p'"2’*  el)  - 

u2=0  ™2 

«2*i  MI1  Kl  c“  V(c(s)).(c<a))  V) 

&  5  u  =0  u2=0  W1  ™2 


-c2*Y  |P(">|2.  l  l  (Y  S  C«  p"2’ 

u=0  u^  /  u2  v=0  ^1  w2 
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Furthermore,  E^($')  =  (Xq  X^  )) 

Substituting  (3.9)  for  E^P^),  we  arrive  at 


Thus,  from  (3.15)-(3*l8)  the  result  holds. 


Q.E.D. 


Corollary;  When  each  block  (v=0, . . . ,M-l)  is  chosen  with  equal 
probabilities  (£=£*)  we  have 


(3.19) 


M(|*,X>p)  =  (o2  +  |pl2) 


M-l 

l 

u=0 


M-l  t  \  a 

t  (2X  -l)|p{u)|2 

u=0 


3.c.  Optimum  strategies 

A  strategy  of  the  Statistician  is  a  pair  of  two  M-dimensional 
vectors  (|,X)  such  that  6  is  a  probability  vector,  and  X'  1^  =  1 
Every  strategy  (|,X)  represents  a  randomization  procedure  and  a 
g.l.s.e.  The  decision  problem  is  to  choose  U,X)  optimally,  with 
respect  to  the  loss  function  M(|,X;P). 

Comparing  (3.1*0  to  (3*19)  it  is  easily  verified  that  for  every 
(|,X)  there  exists  P°  in  E n  su:h  that  M(£,X;P°)  >  M(£*,X}|30)  . 
Thus,  whenever  P  _is  arbitrary,  £*  represents  an  admissible  randomi¬ 
zation  procedure .  For  this  reason  we  shall  restrict  the  discussion 
from  now  on  to  strategies  with  randomization  procedure  £*,  and  turn 
now  to  the  problem  of  deciding  upon  an  optimum  g.l.s.e.  under  |*. 
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We  notice  in  (3.19)  that  M(|*,X}£)  depends  on  &  only  through 
the  M  values  |p^|2.  An  a-priori  information  concerning  these 
values  might  thus  be  utilized  for  the  choice  of  X.  Thus,  let  TT^ 
be  an  a-priori  distribution  of  |^u^|2  ,  defined  over  the  half-line 
[0,®) . 

Theorem  3- 

The  Bayes  g.l.s.e.  of  £,  with  respect  to  the  a-priori  distribu¬ 
tions  (TT(0),...,TT(M‘1))  >  under  randomization  procedure  |*  is 
determined  by  the  vector  X  =  (X^°\  . . . , X^M_1^ )  ,  where 

'  jt  it  ’  ’  it 


(3.20) 


,(u) 


(u),2. 


M-l 

lE»tle 


(u),2. 


for  all  u=0, . . . ,M-1 


u=0  it 


Proof; 

The  risk  function  under  ($*,X)  and  TT  is 


M-l 


,  s  „  M-l  _  M-l 

(u) i2.n  ^  ^2 


(3.21)  RU*,X;TT)  =  (o*  +  l  E(u^lp  I  ))  Z  \  -  l  (2V  -1 

u=0  u=0  u=0  u 


f  f | H(u> | 2, 

E  (u)UP  I  )  • 

Jt 

It  is  easily  verified  that  X^u^  (u=0, . . . ,M-l),  given  by  (3.20), 

M-l 

minimize  (3>2l)  under  the  constraint  £  X  =  1. 

u=0 

Q.E.D. 
M-l 


Let  R^  =  E  (  J  (u=0, . . .  ,M-l)  and  R  =  £  R^U)  then 

IT  '  n  U=0 

the  Bayes  risk  with  respect  to  an  a-priorl  distribution  TT  is 


»|2, 


(u) 
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(3.22) 


R(l*,\;TT)  =  (°2  +  Rn)  1  (\(u))2  - 

u=0 

-  Y  (2^-1)  «iu>  - »„  -  r  d-r>  T  <TU>>2 


In  particular,  when  all  (u=0, . . . ,M-l)  have  the  same  a-priori 

distribution,  with  R^  =  R*  for  all  u=0,  ...,M-1,  then  the  Bayes 

It  It 

g.l.s.e.  is  represented  by  X*  =  (j-j  ,  i  j-j)  with  a  Bayes  risk 


(3-23) 


R(t*,4*,TD  =  §-  +  (m-i)r* 


Theorem  4. 

X*  =  i  ]^M)  represents  the  minimax  and  admissible  g.l.s.e. 

under  randomization  procedure  relative  to  the  class  of  all 

M-l  (u) 

a-priori  distributions  TT  >  such  that  R^  =  £  R^  '  =  const,  and 
2  u=0 

(o  <  R^  <  00).  The  minimax  risk  is  given  by  (5.25). 

Proof: 

The  minimax  risk  is  the  maximal  Bayes  risk,  with  respect  to  all 

the  a-priori  distributions  TT  in  the  class  considered.  The  Bayes 

M-l  ,  \ 

risk  for  any  of  these  fl's  is  given  by  (5-22)  where  R  =  £  R^u' 

u=0 

is  a  given  constant.  Set  the  Lagrangian 


(5.24) 


L(R^°\  .. , 
n 


>R 


(M-l) 


*•)-».  -r 

n  n  u=0 


(u)  \2 


+  p(Rn 


M-l 


I 

u=0 


R(u)) 

It  ' 
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By  differentiating  partially  with  respect  to  (u=0, . . ,,M-l)  and 

p  and  equating  the  derivatives  to  zero  we  arrive  at  the  system  of 
linear  equations: 


(3.25) 


/  2  n  £_\  R(u)  _  . 

'  -  T  U  '  r}  Rit  -  p 

n  n 


for  all  u=0, ...,M-1 


M-l 


I  * 


(u) 


=  R 


u=0 


/  \  K 

The  solution  of  this  system  of  linear  equations  is  given  by  R  u'  =  — - 

Jt  M 


for  every  u=0,  ...,M-1.  Furthermore,  since  R^  >  o 


all  the  second 


order  partial  derivatives  with  respect  to  R 


(u) 


are  negative.  Thus  all 


X*  =  jjj  1'“'  is  then  the  unique  minimax  strategy  for  the  Statistician. 


a-priori  distributions  jt  such  that  R^u^  =  for  every 

u=0, ...,M-1  are  minimax  strategies  for  Nature.  As  mentioned  before, 

_  1  (M) 

*  M  x 

The  Bayes  risk  corresponding  to  X*  is  given  by  (J.25).  The  admissi¬ 
bility  of  X*,  relative  to  the  class  of  a-priori  distributions  con¬ 
sidered,  follows  from  the  fact  that  it  is  the  unique  minimax. 

Q.  £ .  D. 
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4.  The  generaHzed  Inverse  and.  the 

4. a.  The  g.l.s.e.  of  minimum  norm 

A.  Ben- Israel  and  S.  J.  Wersan  (1962)  proved  that  the  g.l.s.e. 

(L^)  with  minimum  norm,  i.e.,  min  tr  ( ) ' ( I »v )  >  is  a  particular 

(Ly) 

generalized  inverse  (C  ) '  of  the  matrix  of  coefficients  in  (2.19), 
namely  (C^)  =  (1,  C^,...,Cyj^  ^ )  X  (C^).  The  generalized  in¬ 
verse  (C  )^"  always  exists,  it  is  unique,  and  given  in  general  by 
the  formula: 

(4.1)  (Cv)+  -  [I(N)  -  (dv)(d;  dv)_1(dv)'](ev)(cv)' 


for  all  v=0, ...,M-1;  where  (E^)  is  a  product  of  elementary  trans¬ 
formations,  which  transforms  (C  )'(C  )  into: 

V  V 


(4.2) 


and  where 


(Ev)(Xy)'(Xv) 


r  i(s) 


L  (o) 

r  (A  )  -i 


V 

•  •  • 

(o) 


(v=0, . . ,,M-1) 


(4.3) 


(D  )  = 


L  _I(N-S) J 


(v=0, . . . ,M-l) 


\i 


The  generalized  inverse  matrix,  (C  )  has  the  properties: 


(4.4)  (Cv)(Cv)T(Cy)  =  (Cy)  for  all  v=0,...,M-l. 

and 

(cv)t(cv)(cv)-  =  (cv)' 

A  straightforward  computation  of  (Cv)"^  according  to  formula  (4.1) 
yields  the  result 
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(4.5) 


(C  _  1 
1  v'  M 


6(0) 

5(1) 

g(M-l) 


That  is,  (cv)"^"  is  a  g.l.s.e.  represented  by  X*  =  jj-  and  has 

the  optimal  properties  mentioned  in  the  previous  section.  This  re¬ 
sult  can  be  obtained  in  the  present  framework  more  easily.  According 
to  (3.8)  a  g.l.s.e.  is  given  by 


(4.6) 


<V  =  i 


X  c(M) 

O  VO 


M_1  Cv(M-l) 


®(C(S))'  (v=0, . . . ,M-l) 


Accordingly,  the  norm  of  (Ly)  is 


(4.7) 


tr. 


(LV)'(LV)  = 


tr. 


.  M-l 

l 

S  u=0 


u 


(c(s))(c(s))') 


=  |  tr. 


M-l 

(  l 

u=0 


1?  i(s)) 
u 


M-l 

=  X 

u=0 


1  ( M )  M-  X  p 

Since  the  vector  X*  =  —  1'  minimizes  T  X  ,  under  the  constraint 

M  **  u 

u=0 

M-l 

V  X  =  1  ,  it  follows  that  the  g.l.s.e.  represented  by  X*  minimizes 
u=0  u 

the  norm  of  (Lv),  (v=0, . . . ,M-l) . 

4.b.  The  g.l.s.e.  suggested  by  C.  R.  Rao. 


C.  R.  Rao  (1962)  defines  the  g.l.s.e.  of  P  by  the  operator 
(Ly)  =  [(C^VCC^)]  (cv)'  where  [ ( ) ’ ( C ^ ) ] ~  is  a  generalized  in¬ 

verse  of  (Cv)'(Cv).  In  case  (C^) •  (Cy)  is  invertible,  (L  )"  is  the 
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unique  g.l.s.e.  of  p.  We  shall  prove  now  that  under  the  present  model 
of  fractional  replication  designs,  Rao's  g.l.s.e.,  (L  )”  ,  is  represented 
hy  the  vector  X.  =  (1,0,0, For  this  purpose,  define  the  matrix 
of  elementary  transformations 

(4.8)  (E  )  = 

v  ✓  s 

then  we  have,  for  every  v=0,  ...,M-1, 

(4.9)  (Ev)[(Cv)'(Cv)](Ev)'  = 

Hence, 

(4.10)  [;cv)'(cv)r  =  (Ev)'(Ev)  . 

To  show  this,  consider  the  relationship 

(4.n)  [(cv)'(cv)][(cv)'(cv)]-((cv)’(cv)i  =  [(cv)*(cv)] 

Multiply  both  sid?s  of  (4.1l)  from  the  left  by  (Ey)  and  from  the 
right  by  (E^)'.  Then, 

(4.12)  (Ev)[(Cv)’(Cv)](Ev)'(Ev)[(Cv)'(Cv)](Ev)'  =  (Ev)[(Cv)'(Cy)](Ev)' 

Or  according  to  (4.9) 


!  (o) 

(o)  y  (o) 


-c 


(M) 


0 


0‘ 


-c 


(M) 

V(M-1) 


Qi 


(s) 
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(4.13) 


2 

CQ 

M 

»  --  ■ 

i(s)!  (o) 

_  L 

*  I(s)j  (of 

O 

o 

- » 

r 

O 

C> 

.(o)  !  (o). 

Accordingly, 


(4.14)  (Lv)"  =  (Ev)'(Ev)(Cv)' 


"  M  r(*0  c(M) 

M  _Cvl  v(M-l) 

C(M) 

‘Cvl  0 

c<"> 

vl 

• 

1  • 

* 

•  • 

•  • 

p(M) 

_"°t(*-1)  0  '•  1 

v(M-l) 

"  1  * 

0 

• 

• 

©  (c(s))’  = 

0 

.  0  . 

•  O 
_ 1 

That  is,  Rao's  g.l.s.e.  (L^)  is  represented  by  \  =  (1,0, . . . ,0) ' . 

From  theorem  1  it  follows  that  (L  )  is  an  unbiased  estimator 
of  (f  0).  The  trace  of  the  dispersion  matrix  of  (L  )“  Y(X  )  , 
under  randomization  procedure  |*  is  given  according  to  (3.19)  by 


(4.15) 


M(S*,X»P)  -  o2  +  2|P|2  -  2|p(0)|2 


o  M-l 
=  a2  +  2  l 
u— 1 


P(U)|2 


Thus,  in  case  all  |^u^|2  have  the  same  a-priori  distribution,  the 
risk  under  strategies  (|*,X  )  and  n  will  be 


2  6 


(4.16) 


R(!*> *.",*)  =  O2  +  2(M-l)  R* 


Comparing  (4.l6)  to  (3.23)  we  conclude  that  Rao's  g.l.s.e.  (L  )” 
might  be  very  far  from  the  optimum  g.l.s.e.  in  case  all  the  subvectors 
of  P  have  approximately  the  same  average  effect.  On  the  other  hand, 
in  case  the  effects  of  p^  to  p^M-1^  are  negligible  relative  to 
the  effect  of  p^  the  Bayes  g.l.s.e.  will  be  very  close  to  Rao's 
g.l.s.e. 
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